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(54) Coding apparatus for picture signal and decoding apparatus therefor 

(57) In an apparatus for coding a moving picture in 
which one frame is comprised of two fields, this appara- 
tus includes coding means such that, with respect to all 
blocks in a frame, the odd field (the first field) and the 
even field (second field) are divided into blocks, thus 
permitting motion prediction of the second field from the 
first field, and coding means adapted for switching, 
every macro block, whether or not a frame is divided 



into the first field and the second field to generate block 
data to adaptively switch these coding means every 
frame, thereby making it possible to obtain a picture of a 
high picture quality with a lesser quantity of information, 
to reduce the scale of hardware, and to reduce the 
capacity of a decoder. 
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Description 
TECHNICAL FIELD 

5 [0001 ] This invention relates to an efficient coding apparatus for a picture signal, which is adapted to efficiently encode 
a picture signal by the orthogonal transform processing. 

BACKGROUND ART 

io [0002] As a system for efficiently encoding a picture signal, e.g., in the standardized scheme by the MPEG (Moving 
Picture Experts Group), an efficient coding system for a picture signal for use in so called digital storage media is stand- 
ardized. 

[0003] Here, storage media subject to this system are media having a continuous transfer rate (speed) of about 1.5 
M bps. (bits per second) such as so called a CD (Compact Disk), a DAT (Digital Audio Tape Recorder), or a hard, disk, 
75 etc. These media are not only directly connected to a decoder, but also are assumed to be connected thereto through 
transmission media such as a bus of a computer, a LAN (Local Area Network), or a telecommunication link, etc. Further, 
not only reproduction in forward direction, but also special functions such as random access, high speed reproduction, 
or reproduction in backward direction, etc. are taken into consideration. 

[0004] The principle of the efficient coding system for a picture signal by the MPEG is as referred to below. 
20 [0005] Namely, in this efficient coding system, a difference between pictures (frames) is first taken to thereby reduce 
the redundancy in the time base direction thereafter to reduce the redundancy in the spatial base direction by using so 
called a Discrete Cosine Transform (DCT) processing and variable length codes. 
[0006] The redundancy in the time base direction will be first described below. 

[0007] Generally, in successive moving pictures, a certain picture remarked (i.e., a picture at a certain time) and pic- 
25 tures before and after that picture are considerably similar to each other. 

[0008] For this reason, as shown in FIG. 22, for example, if an approach is employed to take a difference between a 
picture to be coded from now on and a picture forward in time to transmit that difference, the redundancy in the time 
base direction can be reduced to lessen a quantity of information transmitted. 

[0009] A picture coded in this way is called a Predictive-Coded Picture (P picture or P frame) which will be described 
30 later. 

[0010] Similarly, if an approach is employed to take a difference between the picture to be coded from now on and a 
picture prepared forward or backward in time, and a difference between the picture to be coded from now on and an 
interpolated picture prepared by pictures forward and backward in time to transmit a difference of a smaller value of 
those differences, the redundancy in the time base direction can be reduced to lessen a quantity of information trans- 
35 mitted. 

[0011] A picture coded in this way is called a Bidirectionally Predictive-coded picture (B picture or B frame) which will 
be described later. 

[0012] In FIG. 22, a picture represented by I indicates an Intra-coded picture (I picture or I frame) which will be 
described later, a picture indicated by P indicates the above-mentioned P picture, and a picture indicated by B indicates 

40 the above-mentioned B picture. 

[0013] In order to prepare respective predictive pictures, so called motion compensation is carried out. 
[0014] Namely, in accordance with this motion compensation, e.g., a block of 16x16 pixels (hereinafter called a macro 
block) comprised of, e.g., unit blocks of 8x8 pixels is prepared to search a macro block in which a difference is minimum 
in the vicinity of the position of the macro block of a former picture to take a difference between the macro block and the 

45 searched macro block, thereby making it possible to reduce a quantity of data to be transmitted. 

[001 5] Actually, for example, in the P picture (Predictive-coded picture), picture data having a lesser quantity of data 
of a picture in which a difference between a picture to be coded from now on and a motion-compensated predictive pic- 
ture is taken and a picture in which a difference between the picture to be coded from now on and the motion-compen- 
sated predictive picture is not taken is selected every macro block of 16x16 pixels, and the selected picture data is then 

so coded. 

[0016] However, in cases as described above, many data must be transmitted with respect to, e.g., the portion (pic- 
ture) appearing from behind the portion where an object moves. 

[0017] In view of this, for example, in the B picture (Bidirectionally Predictive-coded picture), there is coded picture 
data in which the quantity of data is the smallest of four picture data i.e., a difference between an already decoded 
55 motion compensated picture forward in time and the picture to be coded from now on; a difference between an already 
decoded motion compensated picture backward in time and the picture to be coded from now on; a difference between 
an interpolated picture prepared by the both pictures forward and backward in time and the picture to be coded from 
now on; and a picture in which a difference is not taken, i.e., the picture to be coded from now on. 
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[0018] The redundancy in the spatial base direction will now be described. 

[001 9] A difference of picture data is caused to undergo Discrete Cosine Transform (DCT) processing every unit block 
of 8x8 pixels without adopting an approach to transmit such a difference as it is. 

[0020] In this DCT processing, a picture is not represented by the pixel level, but is represented by to what degree 
5 respective frequency components of a cosine function are included. For example, by the two-dimensional DCT process- 
ing, data of unit blocks of 8x8 pixels are transformed to data of coefficient blocks of 8x8 pixels of components of a cosine 
function. 

[0021] There are many instances where a picture signal of a natural picture as imaged by a television camera 
becomes a smooth signal. In this instance, the above-mentioned DCT processing is implemented to the picture signal, 
10 thereby making it possible to reduce a quantity of data. 

[0022] Namely, for example, in the case of a smooth signal like a picture signal of a natural picture as described above, 
the DCT processing is implemented thereto, whereby large values concentrate on values in the vicinity of a certain coef- 
ficient. 

[0023] When this coefficient is quantized, most of coefficient values of the DCT coefficient block of 8x8 become equal 

75 to zero, so only large coefficient values are left. 

[0024] In transmitting data of coefficient block of 8x8, an approach is employed to transmit such data, in order of so 
called a zigzag scan, by using so called a Huffman codes in which a non-zero coefficient and so called zero-run indi- 
cating how many number of zeros continue before that coefficient are combined as each set, thereby making it possible 
to reduce a quantity of data transmitted. 

20 [0025] On the decoder side, a picture is reconstructed by a procedure opposite to the above. 
[0026] The structure of data handled by the above-described coding system is shown in FIG. 23. 
[0027] Namely, data structure shown in FIG. 23 is comprised of a block layer, a macro block layer, a slice layer, a pic- 
ture layer, a Group of Picture (GOP) layer, and a video sequence layer in order from the bottom. Explanation will now 
be described in order from a lower layer in FIG. 23. 

25 [0028] In the block layer, each block of this block layer is comprised of luminance or color difference adjacent 8x8 pix- 
els (pixels of 8 lines x 8 pixels). 

[0029] The above-described DCT (Discrete Cosine Transform) processing is applied every unit block. 
[0030] In the above-mentioned macro block layer, each macro block of the macro block layer is comprised of six blocks 
in total of four luminance blocks (unit blocks of luminance) Y0, Y1, Y2, Y3 adjacent in left and right directions and in 
so upper and lower directions, and color difference blocks (unit blocks of color difference) Cr, Cb existing correspondingly 
at the same positions as those of the luminance blocks on a picture. 
[0031] Those blocks are transmitted in order of Y0, Y1 , Y2, Y3, Cr and Cb. 

[0032] In this coding system, what picture is used for a predictive picture (a reference picture for taking a difference), 
or whether or not there is a need to transmit a difference is judged every macro block. 
35 [0033] The above-mentioned slice layer is comprised of one or plural macro blocks successive in order of scanning 
of a picture. 

[0034] At the header of this slice layer, differences between respective motion vectors in a picture and a DC (Direct 
Current) component are reset. The first micro block has data indicating position in a picture. Accordingly, even in the 
case where an error takes place, data can be restored to a normal state every slice. 
40 [0035] For this reason, the length and starting position of the slice are arbitrary, and can be changed in dependency 
upon an error state of a transmission path. 

[0036] In the above-mentioned picture layer, a picture, i.e., each frame is comprised of at least one or plural slices 
mentioned above. These pictures are respectively classified into four kinds of pictures of the Intra-coded picture (I pic- 
ture or I frame), the Predictive-coded picture (P picture or P frame), the Bidirectional predictive-coded picture (B picture 
45 or B frame), and DO intra coded picture. 

[0037] In the intra coded picture (I picture), when a picture is coded, information only within that picture is used. 
[0038] In other words, at the time of decoding, a picture can be reconstructed only by information of the I picture itself. 
In actual terms, a picture is caused to undergo DCT processing as it is without taking a difference, and the picture thus 
processed is then coded. 

50 [0039] Although this coding system has a poor efficiency in general, if such l pictures are inserted at suitable portions, 
random access or high speed reproduction can be made. 

[0040] In the above-mentioned Predictive coded picture (P picture), an I picture or a P picture, which is positioned 
forward in time in terms of input sequence and has been already decoded, is used as a predictive picture (a picture 
serving as a reference in taking a difference). 
55 [0041] Actually, any one of a higher efficiency of the method of coding a difference between a picture to be coded from 
now on and a motion compensated predictive picture and the method of coding a picture as it is without taking a differ- 
ence therebetween (intra coding) is selected every macro block. 

[0042] In the above-mentioned Bidirectional predictive coded picture (B picture), three kinds of pictures of an I picture 
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and a P picture which are positioned forward in time and have been already decoded, and an interpolated pictures pre- 
pared from the both pictures are used as a predictive picture. 

[0043] Thus, a picture having the highest efficiency of the three kinds of motion compensated coded pictures of lv- 
ference and the intra-coded picture can be selected every macro block. 
5 [0044] The DC intra-coded picture is an intra coded picture comprised of only DC coefficients of DCT, and therefore 
cannoi exist in the same sequence as that of other three kinds of pictures. 

[0045] The above-mentioned Group Of Picture (GOP) layer is comprised of only one or plural I pictures, or one or 
plural I pictures and plural non-l pictures. When the order of inputting to an encoder is assumed to be, e.g., 1 1, 2B, 3B, 
4P*5B, 6B, 71, 8B, 9B, 101, 11 B, 12B, 13P, 14B, 15B, 16P*17B, 18B, 191, 20B, 21 B, and 22P, an output of the encoder, 
io i.e., an input of a decoder is, e.g., 11, 4P, 2B, 3B*7I, 5B, 6B, 101, 8B, 9B, 13P, 11B, 12B, 16P, 14B, 15B*19I. 17B, 18B, 
22P, 20B, and 21 B. 

[0046] The reason why exchange of the order is carried out in the encoder in this way is that in the case where, e.g., 
the B picture is coded or decoded, the I picture or the P picture backward in time serving as a predictive picture of the 
B picture must be coded in advance. 
is [0047] In this case, the interval (e.g., 9) of the I picture, and the interval (e.g., 3) of the P picture or the B picture are 
arbitrary. 

[0048] Further, the interval of the I picture or P picture may be changed in the Group Of Picture layer. 
[0049] It is to be noted that the connecting portion of the Group Of Picture layer is indicated by asterisk (*). 
[0050] In FIG. 23 reference symbols I, P and B indicate I picture, P picture and B picture, respectively. 
20 [0051] The above-mentioned video sequence layer is comprised of one or plural Group Of Picture layers in which the 
picture size and the picture rate, etc. are the same. 

[0052] As described above, in the case of transmitting a moving picture standardized in accordance with the efficient 
coding system by the MPEG, picture data obtained by compressing one frame (picture) in a picture is first sent, and 
data of a difference between that picture and a picture obtained by implementing motion-compensation thereto is then 
25 transmitted. 

[0053] Meanwhile, in the case of processing, e.g., a field as a picture in the above-mentioned one frame (picture), 
vertical positions vary interchangeably at respective 2 fields. For this reason, also at the time of transmitting, e.g., a still 
picture, difference information will have to be transmitted. 

[0054] Further, for example, in the case of processing, with a picture being as a unit, a frame obtained by processing 
30 fields as a picture, a picture moved in so called a comb shape will have been processed with respect to, e.g., a moving 
portion in the frame. 

[0055] Namely, in the case where a moving body CA such as an automotive vehicle, etc. exists on this side of a still 
background as shown in FIG. 24, for example, since there is motion (movement) between fields when attention is drawn 
to one frame, such a portion would be a picture in a comb form KS. 

35 [0056] Further, in the case of processing a picture in which, e.g., still or stationary portions and moving picture por- 
tions are mixed, even if there is employed any one of the method of processing field as a picture and the method of 
processing frame as a picture, a picture portion having a poor compression efficiency would be in the picture. 
[0057] This invention has been proposed in view of actual circumstances as described above, and its object is to pro- 
vide an efficient coding apparatus for a picture signal, which is capable of efficiently carrying out the field processing or 

40 the frame processing even if a picture to be coded is a picture having small movement or great movement, or a picture 
in which those pictures are mixed with respect to a picture of the field structure. 

[0058] Japanese Published Patent Applications JP-A-59 128 881 and JP-A-58 137 379 disclose image data compres- 
sion systems in which both interframe and interf ield motion vectors are calculated and a selection of which should be 
used in the data compression made on a block-by-block basis. The present invention aims to improve coding efficiency. 
45 [0059] According to the invention there is provided an encoder for encoding a sequence of frame pictures, each frame 
picture being comprised of plural macroblocks (MB), each of said frame pictures having a first field picture (Odd) and a 
second field picture (Even); said encoder comprising: 

a motion detector for detecting motion within said frame pictures and said first and second field picture; 
so a selector for selecting (34), in dependence upon said detected motion, either a first encoding mode or a second 

encoding mode on a frame picture basis; characterised by 

when said first encoding mode is selected, an orthogonal transform encoder carties out orthogonal transform 
encoding of said plural macroblocks by adaptively selecting on a macroblock basis either 

55 (i) a frame processing mode for orthogonally transforming a block comprised of a portion of a first field and a 

portion of a second field, or 

(ii) a field processing mode for orthogonally transforming a block comprised of either said portion of said first 
field or said portion of said second field; and 
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when said second encoding mode is selected, said orthogonal transform encoder carries out orthogonal transform 
encoding of blocks composed only of said first field of a frame picture and then carries out orthogonal transform 
encoding of blocks composed only of said second field of said frame picture with said second field being predic- 
tively coded using said first field. 

5 

[0060] Embodiments of image data coding systems will now be described, by way of example only, with reference to 
the accompanying drawings in which: 

FIG. 1 is a block diagram showing the outline or the configuration of an efficient coding apparatus for a picture sig- 
10 nal of a first embodiment using an intermediate technique useful in understanding the invention. 

FIG. 2 is a block diagram showing the outline of the configuration of an efficient coding apparatus for a picture sig- 
nal of a second embodiment using an intermediate technique useful in understanding the invention. 
TIG. 3 is a block diagram showing the outline of the configuration of an efficient coding apparatus for a picture sig- 
nal of a third embodiment, that is an embodiment of the present invention. 
is FIG. 4 is a view for explaining the coding processing of this embodiment. 
FIG. 5 is a view showing a macro block. 

FIG. 6 is a view showing motion prediction in the case or the frame orthogonal transform mode in the first coding 
processing 

FIG. 7 is a view showing motion prediction in the case of the field orthogonal transform mode in the first coding 
20 processing. 

FIG. 8 is a view showing motion prediction in the case of the second coding processing mode. 
FIG. 9 is a view showing a unit block of the DCT processing in the frame orthogonal transform mode/field process- 
ing mode in an actual example of a format of a digital VTR. 
FIG. 10 is a view showing the state of motion prediction. 
25 FIG. 11 is a view showing another state of motion prediction. 

FIG. 12 is a view showing a unit block of the DCT processing in the frame orthogonal transform mode/field orthog- 
onal transform mode in an actual example of a format of a digital VTR. 

FIG. 13 is a view showing a unit block of the DCT processing in the frame orthogonal transform mode/field orthog- 
onal transform mode in another actual example of a format of a digital VTR. 
30 FIG. 14 is a view showing a unit block of the DCT processing in the frame orthogonal transform mode/field orthog- 
onal transform mode in a further actual example of a format of a digital VTR. 

FIG. 1 5 is a view for explaining a sets of macro blocks and the manner of processing in the frame orthogonal trans- 
form mode. 

FIG. 16 is a view for explaining the manner of processing in the field orthogonal transform mode in the example of 
35 FIG. 15. 

FIG. 17 is a view for explaining a modified example (as to forward prediction) of addition of expansion bits in the 
second embodiment. 

FIG. 1 8 is a block diagram showing the outline of the configuration of an efficient coding apparatus for a picture sig- 
nal of a fourth embodiment using an intermediate technique useful in understanding the invention. 

40 FIG. 1 9 is a block diagram showing the configuration of a decoder. 
FIG. 20 is a view showing a picture in the odd cycle. 
FIG. 21 is a view showing a picture in the even cycle. 
FIG. 22 is a view for explaining respective predictive pictures. 
FIG. 23 is a view showing data structure. 

45 FIG. 24 is a view showing a certain picture of a moving body. 

[0061 ] First, main flow of picture data subjected to coding processing in a first embodiment will be described by using 
the configuration of FIG. 1 . 

[0062] Next, second and third embodiments will be described with reference to FIGS. 2 and 3, respectively. 
so [0063] Further, a fourth embodiment will be described with reference to FIG. 18. Finally, an embodiment of the con- 
figuration of a decoder of this invention will be described with reference to FIG. 19. 

[0064] It is to be noted that, in coding apparatuses of the embodiments, there may be carried out three kinds of coding 
processing of an Interframe coding (I frame or I picture) processing, a (unidirectional) Predictive interframe (interframe) 
coding (P frame or P picture) processing, and a Bidirectional interpicture coding (B frame or B picture) processing which 
55 are ail as shown in FIG. 4. In addition, respective pictures are constituted as a block comprised of 8x8 pixels and each 
macro block is comprised of 2x2 blocks (i.e., 16x16 pixels). 
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[Description of the first embodiment] 

[0065] FIG. 1 shows a first embodiment of an efficient coding apparatus for a picture signal, which is adapted to carry 
out coding with a macro block comprised of a two-dimensional arrangement of pixels which is smaller than one picture 
5 (e.g., a block in which 16x16 pixels in a spatial arrangement of input picture data in order of a raster scan are assumed 
as a unit block) being as a unit. 

[0066] This efficient coding apparatus comprises the following components. 

[0067] Namely, the efficient coding apparatus comprises a group of frame memories 10 in which a plurality of frames 
(pictures) comprised of a plurality of unit blocks of 16x16 pixels are stored as an original picture, and 

10 

a frame motion detection circuit 22 and a field motion detection circuit 21, which serve as motion detection means 
for detecting, every macro block, motion vectors between frames and a sum of differences of absolute values of 
respective pixels, and for detecting, every macro block, motion vectors between fields obtained by dividing a frame 
in dependency upon odd and even scans of pixels and a sum of differences between absolute values of pixels, 
75 respectively. 

[0068] The efficient coding apparatus further comprises motion prediction mode judgment circuit 23 and a selector 
24, which serve as first mode selection means for judging, by using information outputted from the motion detection 
means, which any one of a frame prediction mode for carrying out motion compensation with a frame comprised of the 

20 macro blocks being as a unit and a field prediction mode for carrying out motion compensation with a field comprised 
of the macro blocks being as a unit has a higher efficiency, thus to select a prediction mode of a higher efficiency. 
[0069] The efficient coding apparatus further comprises a block data generation mode judgment circuit 25, serving 
as second mode selection means, which is adapted to judge, by using information outputted from the motion detection 
means and the first mode selection means, which any of one a frame orthogonal transform mode for transforming input 

25 picture data to block data so as to carry out orthogonal transform processing with a frame comprised of macro blocks 
being as a unit and a field orthogonal transform mode for transforming input picture data to block data so as to carry out 
orthogonal transform processing with a field comprised of macro blocks being as a unit has a higher efficiency in car- 
rying out orthogonal transform processing, thus to select a block data generation mode of a higher efficiency. 
[0070] The efficient coding apparatus further comprises an address generator 1 1 for recognizing whether a current 

30 cycle is an odd cycle of a time period during which scan of odd fields in an interlaced scan of the coding processing is 
carried out, or an even cycle of a time period during which scan of even fields in that interlaced scan is carried out with 
respect to one frame, thus to control the group of frame memories so as to output macro block data generated in cor- 
respondence with the block data generation mode in the odd cycle, and 

35 a group of frame memories 20 with a motion compensator, which serves as motion compensation means adapted 
to receive motion prediction mode information selected by the first mode means and block data generation mode 
information selected by the second mode selection means, thus to execute motion compensation interframe or 
interfield prediction in correspondence with the mode information. 

40 [0071] Namely, in FIG. 1 , a digital picture signal is delivered to an input terminal 1 , and is then stored into the group 
of frame memories 10. From the group of frame memories 10, data of unit macro block of 16x16 pixels are read out 
under the control of the address generator 1 1 of which operation will be described later in detail. The data thus read out 
are transmitted to a subtracter 1 2. To the subtracter 12, motion compensated picture data from the group of frame mem- 
ories 20 with motion compensator are also delivered. Each difference between the data of unit macro blocks and the 

45 motion-compensated picture data is detected at the subtracter 12. 

[0072] An output of the subtracter 12 is sent to a DCT circuit 13 for carrying out orthogonal transform (DCT) process- 
ing. While DCT is shown as an example, other orthogonal transform processing such as FFT, etc. may be of course 
applied as the orthogonal transform processing. 

[0073] DCT coefficient data obtained by DCT processing at the DCT circuit 13 is sent to a quantizer 14. Quantized 
so data from the quantizer 14 is outputted as coded data from an output terminal 2 through a variable length encoder 15 
for carrying out variable length coding processing, e.g., so called Huffman coding or run length coding, etc. and a buffer 
16. 

[0074] This coded data is not only transmitted through a predetermined communication path, but is also permitted to 
be written into recording media such as an optical disk or a magnetic tape, etc. 
55 [0075] Further, the quantized data from the quantizer 14 is delivered to the group of frame memories 20 with motion 
compensator through an inverse quantizer 17 for carrying out inverse quantization processing of the quantization 
processing at the quantizer 1 4 and an inverse DCT circuit for carrying out inverse DCT processing of the DCT process- 
ing at the DCT circuit 13, and through an adder 1 9. At the adder 1 9, an output of the inverse DCT circuit 18 and an out- 
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[0090] In actual terms, in the case where it is judged at the block data generation mode judgment circuit 25 that a 
10 difference between a difference EFM determined with respect to the frame and a difference EFD determined with 
respect to the field by using the above formulas (1) and (2) is greater than a certain threshold value T2 (when EFM- 
EFD>T2), this circuit 25 outputs data indicating that the DCT processing at the DCT circuit 13 is carried out every field 
(data MDFD in the field orthogonal transform mode in the block data generation processing). In contrast, in the case 
where it is judged that a difference between the difference EFM and the difference EFD is smaller than the threshold 
75 value T2 or is equal thereto (when EFM-EFD<T2), the block data generation mode judgment circuit 25 outputs data 
indicating that the DCT processing at the DCT circuit 13 is carried out every frame (data MDFM in the frame orthogonal 
transform mode in the block data generation processing). Any one of these blockdata generation processing mode data 
MDFM/MDFD is transmitted to the address generator 1 1 and the group of frame memories 20 with motion compensa- 
tor. Further, the motion vector data (FMMV/FDMV), the block data generation mode data (MDFM/MDFD), and the pre- 
20 dictive mode data (MPFM/MPFD) are sent to the above-described variable length encoder 15. 

[0091] The address generator 1 1 controls the group of frame memories 10 so as to output macro block data gener- 
ated in dependency upon processing mode data MDFM/MDFD at the DCT circuit 13 every macro block, for example, 
with respect to picture data stored in the group of frame memories 10. 

[0092] Namely, in the case where the block data generation mode data is data MDFM indicating DCT processing 
25 every frame, the address generator 1 1 controls the group of frame memories 10 so as to output macro block data in 
which even pixels and odd pixels are alternately arranged as shown in FIG. 5(B). Thus, unit block data of the macro 
block sent to the DCT circuit 13 are data in which even fields and odd fields are combined. 

[0093] In contrast, in the case where the block data generation mode data is data MDFD indicating DCT processing 
every field, the address generator 1 1 controls the group of frame memories 1 0 so as to macro block data in which even 
30 pixels and odd pixels are separately arranged as shown in FIG. 5(C). 

[0094] Thus, unit block data of the macro block sent to the DCT circuit 1 3 is data in which even fields and odd fields 
are separate with each other. It is to be noted that the DCT circuit 13 carries out DCT transform processing every unit 
block of 8x8 pixels as described above. In FIGS. 5(B) and 5(C), odd lines are indicated by solid lines, and even lines are 
indicated by dotted lines. 

35 [0095] To the group of frame memories 20 with motion compensator, predictive mode data MPFM/MPFD from the 
motion predictive mode judgment circuit 23, processing mode data MDFM/MDFD from the DCT mode judgment circuit 
25, and motion vector data FMMV/FDMV selected at the selector 24 are delivered. Accordingly, this group of frame 
memories 20 with motion compensator carries out motion compensation corresponding to the predictive mode data 
MPFM/MPFD in the motion prediction and block data generation mode data MDFM/MDFD in the DCT processing and 

40 using the motion vector data FMMV/FDMV. 

[Description of the Second Embodiment] 

[0096] FIG. 2 shows a second embodiment. In FIG. 2, blocks to which the same reference numerals as those of FIG. 
45 1 are attached have the same functions, respectively. Accordingly, explanation will now be given in connection with to 
which reference numerals different from those of FIG. 1 are attached. 

[0097] Namely, an efficient coding apparatus of FIG. 2 comprises, in addition to the blocks to which the same refer- 
ence numerals as those of the efficient coding apparatus of FIG. 1 are attached, 

so a mode judgment circuit 26 and a selector 24 which serve as mode selection means to judge, by using information 
outputted from the motion detection means, which any one of an efficiency in the case where the motion compen- 
sation is carried out in the frame prediction mode and block data generation for the orthogonal transform process- 
ing is carried out in the frame orthogonal transform mode, and an efficiency in the case where the motion 
compensation is carried out in the field predictive mode and block data generation for the orthogonal transform 

55 processing is carried out in the field orthogonal transform mode has a higher value, thus to select a predictive mode 



of a higher efficiency, and 

an address generator 31 serving as address generation means for recognizing whether a current cycle is an odd 
cycle o1 a time period during which scan of odd fields is carried out or an even cycle of a time period during which 
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scan of even fields is carried out in an interlaced scan of the coding processing with respect to one frame (one pic- 
ture), thus to control the group of frame memories so as to sequentially output, by one frame, odd fields of respec- 
tive macro blocks in the odd cycle only when the mode of the mode judgment circuit 26 is field prediction/field 
processing mode thereafter to sequentially output, by one frame, even fields of respective macro blocks in the even 
5 cycle. 

[0098] It is to be noted that the coding apparatus of the second embodiment is a coding apparatus in which the block 
data generation mode and the motion compensation mode are not separate with each other. The second embodiment 
essentially different from the first embodiment in the operation of the address generator as described above. 

io [0099] The mode judgment circuit 26 in FIG. 2 carries out, on the basis of data FMAD of a sum of differences between 
absolute values from the frame motion detector 22 and data FDAD of a sum of differences between absolute values 
from the field motion detector 21 , judgment as to whether the motion predictive processing should be carried out every 
frame or the motion predictive processing should be carried out every field in the motion predictive processing at the 
group of frame memories 20 with motion compensator of which operation will be described later in detail, and prepares 

15 a difference picture by using the judged result (corresponding to the predictive mode data MPFM/MPFD of the first 
embodiment), motion vectors FMMV/FDMV from the motion detectors (21, 22), and pictures from the group of frame 
memories 10, thus to also judge, on the basis of the difference picture, a mode of the block data generation processing 
most suitable for a picture which is outputted from the group of frame memories 10 and is subjected to DCT processing 
at the DCT circuit 13. 

20 [01 00] Namely, this mode judgment circuit 26 judges which any one of an efficiency in the case where the motion pre- 
diction is carried out in the frame predictive mode and generation of block data is carried out in the frame orthogonal 
transform mode PDFM and an efficiency in the case where the motion prediction is carried out in the field predictive 
mode and the generation of block data is carried out in the field orthogonal transform mode PDFD has a higher value. 
In other words, the mode judgment circuit 26 is of a structure in which the functions of the motion predictive mode judg- 
es ment circuit 23 and the block data generation circuit 25 are combined. 

[0101] It is to be noted that actual judgment of mode may be carried out similarly to the motion predictive mode and 
the block data generation mode in the first embodiment, for example. 

[01 02] The address generator 31 control the group of frame memories 1 0 so as to output macro block data generated 
as block data in accordance with the mode data PDFM/PDFD every macro block, for example, with respect to picture 
30 data stored in the group of frame memories 10. Namely, in the case where the above-mentioned mode data is data 
PDFM indicating coding processing every frame, the address generator 31 control the group of frame memories 10 so 
as to output macro block data shown in FIG. 5(B). Thus, unit block data of the macro block sent to the DCT circuit 13 is 
data in which even fields and odd fields are combined. 

[0103] In contrast, in the case where the above-mentioned mode data is data PDFD indicating coding processing 
35 every field, the address generator 31 controls the group of frame memories 10 so as to sequentially output, by one 
frame (one picture), odd fields of respective macro blocks in the odd cycle thereafter to sequentially output, by one 
frame (one picture), even fields of respective macro blocks in the even cycle. Thus, unit block data of the macro block 
sent to the DCT circuit 13 is macro block data comprised of only odd fields in the odd cycle and is macro block data 
comprised of only even fields in the even cycle. 
ao [0104] Namely, in the above-described efficient coding apparatuses of the first and second embodiments, since 
switching between the frame predictive mode and the field predictive mode in the motion prediction, and/or between the 
frame orthogonal transform mode and the field orthogonal transform mode in generation of block data in the DCT 
processing can be carried out every macro block, the highest efficient coding can be made every macro block. 
[0105] The coding apparatuses of the first and second embodiments carry out motion prediction and DCT transform 
45 processing as shown below every format of so called a digital VTR, for example. 
[0106] In FIG. 11, and FIGS. 10(A), (B), 

fields constituting the I frame (I picture) are assumed to be an lo field (odd field of the I frame) and le field (even 
field of the I frame), 

so fields constituting the P frame (P picture) are assumed to be a Po field (odd field) and a Pe field (even field), and 

fields constituting the B frame (B picture) are assumed to be a Bo field (odd field) and a Be field (even field). 

[0107] In the first and second embodiments, as shown in FIG. 5(B) referred to before, the frame orthogonal transform 
mode in generation of block data is a mode in which odd fields are even fields are combined to constitute the macro 
55 blocks (i.e., constitute macro blocks every frame) to use this macro block as a processing unit. Further, as shown in FIG. 
5(C) referred to above, the field orthogonal transform mode in generation of block data is a mode to constitute macro 
blocks separately by odd and even fields (i.e.. constitute macro blocks every field) to use this macro block as a process- 
ing unit. Accordingly, in one frame, for example, switching between the frame orthogonal transform mode and the field 
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orthogonal transform mode is carried out every macro block. 

[0108] Further, in the efficient coding apparatus of the first and second embodiments, with respect to one frame, the 
coding processing is divided into an odd cycle of a time period during which scan of odd fields in an interlaced scan is 
carried out and an even cycle during which scan of even fields in the interlaced scan is carried out. 
5 [0109] In the first embodiment, e.g., in the case of handlings digital VTR format of so called 4:2:0 component, as 
shown in FIG. 9, when generation of block data is carried out in the frame orthogonal transform mode, DCT processing 
of respective unit blocks of a macro block comprised of luminance blocks Y0 Y1 , Y2, Y3 of odd and even fields and color 
difference blocks CbO, Cr1 of the odd field is carried out. 

[0110] On the contrary, when generation of block data is carried out in the field orthogonal translorm mode, DCT 
10 processing of respective unit blocks of a macro block comprised of luminance blocks Y02o, Y13o of respective odd 
fields, luminance blocks Y02e, Y13e of respective even fields, and color difference blocks CbO, CM of odd fields is car- 
ried out. 

[0111] With respect to the motion prediction in the case of the example of FIG. 9, as shown in FIG. 10(A), when the 
prediction mode is the frame predictive mode, a motion prediction MCP between the I frame and the P frame can be 

75 carp'-rd out. On the contrary, in the field predictive mode, a motion prediction MCoPo between the lo field and the Po 
field <* motion prediction PCoPe between the lo field and the Pe field, a motion prediction MCePo between the !e field 
and trtii Po field, and a motion prediction MCePe between the le field and the Pe field can be carried out. Namely, in the 
case of FIG. 10(A), the motion predictive processing and the processing for generating block data can exist independ- 
ently with respect to the frame prediction/processing mode and the field prediction/processing mode. In the frame pre- 

20 diction mode, one motion vector is determined. In the field prediction mode, two motion vectors are determined. 

[01 1 2] Accordingly, in the first embodiment, when generation of block data is carried out in the frame orthogonal trans- 
form mode, the lo field and the le field are combined in the above-mentioned odd cycle. Thus, the macro block is con- 
stituted. For example, in the odd cycle, DCT processing (DCT processing is carried out every unit block of 8x8 pixels), 
quantization, and variable length coding are carried out every macro block. On the contrary, no data is transmitted in 

25 the even cycle. 

[01 1 3] When generation of block data is carried out in the field orthogonal transform mode, the macro block is consti- 
tuted with the lo field and the le field being separate with each other in the odd cycle. Thus, DCT processing (DCT 
processing is carried out every unit block of 8x8 pixels), quantization, and variable length coding are carried out every 
macro block. On the contrary, no data is transmitted in the even cycle as seen from FIG. 9. 

30 [0114] In the case of the P frame, processing as described below will be conducted. For example, when generation 
of block data of the P frame is carried out in the frame orthogonal transform mode and the motion prediction is carried 
out in the frame prediction mode, an approach is employed in the odd cycle to assume a reference picture to be a pic- 
ture forward in time (picture of one frame) to detect a motion vector MVP between frames to assume the macro block 
in which lo fields and le fields are combined one after another as a predictive picture to encode a difference between 

35 the predictive picture and an original picture. On the other hand, no data is transmitted in the even cycle. 

[0115] When generation of block data of the P frame is carried out in the frame orthogonal transform mode and the 
motion prediction is carried out in the field prediction mode, an approach is employed in the odd cycle to respectively 
assume the lo field and the le field (or the Po field and the Pe field) to be reference pictures to detect a motion vector 
MVoPo between the lo field and the Po field, a motion vector MVePo between the le field and the Po field, a motion vec- 

40 tor MVoPe between the lo field and the Pe field, and a motion vector MVePe between the le field and the Pe field to 
select a prediction in which a predictive error between a reference frame and a current P frame is minimum of prediction 
of odd fields, prediction of even fields, and prediction obtained by combining the both predictions (e.g., an average of 
prediction of even fields and prediction of odd fields) to assume the macro block in which lo fields and le fields are com- 
bined as a predictive picture to encode a difference between the predictive picture and an original picture. On the other 

45 hand, no data is transmitted in the even cycle. 

[01 1 6] Further, when generation of block data of the P frame is carried out in the field orthogonal transform mode and 
the motion prediction is carried out in the frame prediction mode, an approach is employed in the odd cycle to assume 
a reference picture to be a picture of the I frame (or a picture of the P frame) to detect a motion vector MVP between 
frames to assume the macro block constructed so that lo fields and le fields are separate with each other as a predictive 

so picture to encode a difference between the predictive picture and an original picture (a macro block constructed so that 
Po fields and Pe fields are separate with each other). On the other hand, no data is transmitted in the same manner as 
above in the even cycle. 

[0117] When generation of block data of the P frame is carried out in the field orthogonal transform mode and the 
motion prediction is carried out in the field prediction mode, an approach is employed in the odd cycle to respectively 
55 assume the lo field and the le field (or Po field and Pe field) to be reference pictures to detect a motion vector MVoPo 
between the lo field and the Po field, a motion vector MVePo between the le field and the Po field, a motion vector 
MVoPe between the lo field and the Pe field, and a motion vector MVePe between the le field and the Pe field to select 
a prediction in which a predictive error between a reference frame and a current P frame is minimum of prediction of 
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odd fields, prediction of even fields (e.g., an average of prediction of even fields and prediction of odd fields) to assume 
the macro block constructed so that lo fields and le fields are separate with each other as a predictive picture to encode 
a difference between the predictive picture and an original picture (a macro block constructed so that Po fields and Pe 
fields are separate with each other). On the other hand, no data is transmitted in the even cycle. 
5 [0118] In the case of the B Irame, processing as described below will be carried out. 

[0119] For example, when generation of block data of the B frame is carried out in the frame orthogonal transform 
mode and the motion prediction is carried out in the frame prediction mode, an approach is employed in the odd cycle 
to assume a reference picture to be pictures forward and backward in time to detect motion vectors between frames, 
i.e., a motion vector FMVB between the I frame and the B frame and a motion vector BMVB between the P frame and 
io the B frame to select a prediction in which a predictive error between a reference frame and a current frame is minimum 
of the forward prediction, the backward prediction and the bidirectional prediction (average of the forward prediction and 
the forward prediction) to assume the macro block in which odd fields and even fields are combined one after another 
as a predictive picture to encode a difference between the predictive picture and an original picture. On the other hand, 
no data is transmitted in the even cycle. 
75 [0120] When generation of block data of the B frame is carried out in the frame orthogonal transform mode and the 
motion prediction is carried out in the field predictive mode, an approach is employed in the odd cycle to assume a ref- 
erence picture to be pictures forward and backward in time to respectively carry out prediction of odd fields and predic- 
tion of even fields with respect to these pictures to detect motion vectors, i.e.. a motion vector FMVoBo between the lo 
field and the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector FMVoBe between 
so the lo field and the Be field, a motion vector FMVeBe between the le field and the Be field, a motion vector BMVoBo 
between the Po field and the Bo field, a motion vector BMVeBo between the Pe field and the Bo field, a motion vector 
BMVoBe between the Po field and the Be field, and a motion vector BMVeBe between the Pe field and the Be field to 
select a prediction in which a predictive error between a reference frame and a current frame of prediction of odd fields 
prediction of even fields by respective vectors, and prediction obtained by combining them (e.g., an average of predic- 
ts tion of even fields and prediction of odd fields) to assume the macro block in which lo fields and le fields (or Po fields 
and Pe fields) are combined as a predictive picture to encode a difference between the predictive picture and an original 
picture. On the other hand, no data is transmitted in the even cycle. 

[0121 ] Further, when generation of block data of the B frame is carried out in the field orthogonal transform mode and 
the motion prediction is carried out in the frame prediction mode, an approach is employed in the odd cycle to assume 

30 a reference picture to be pictures forward and backward in time to detect motion vectors between frames, i.e., a motion 
vector FMVB between the I frame and the B frame and a motion vector BMVB between the P frame and the B frame to 
select a prediction in which a predictive error between a reference frame and a current frame is minimum of the forward 
prediction, the backward prediction, and bidirectional prediction (an average of the forward prediction and the backward 
prediction) to assume the macro block constructed so that odd fields and even fields are separate with other as a pre- 

35 dictive picture to encode a difference between the predictive picture and an original picture. On the other hand, no data 
is transmitted in the even cycle. 

[0122] When generation of block data of the B frame is carried out in the field orthogonal transform mode and the 
motion prediction is carried out in the field prediction mode, an approach is employed in the odd cycle to assume a ref- 
erence picture to be pictures forward and backward in time to respectively carry out prediction of odd fields and predic- 

40 tion of even fields with respect to these pictures to detect respective motion vectors, i.e., a motion vector FMVoBo 
between the lo field and the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector 
FMVoBe between the lo field and the Be field, a motion vector FMVeBe between the le field and the Be field, a motion 
vector BMVoBo between the Po field and the Bo field, a motion vector BMVeBo between the Pe field and the Bo field, 
a motion vector BMVoBe between the Po field and the Be field, and a motion vector BMVeBe between the Pe field and 

45 the Be field to select a prediction in which a predictive error between a reference frame and a current frame is minimum 
of prediction of odd fields and prediction of even fields by respective vectors and the prediction obtained by combining 
both predictions (e.g., an average of prediction of even fields and prediction of odd fields) to assume the macro block 
constructed so that lo fields and le fields (or Po fields and Pe fields) are separate with each other) as a predictive picture 
to encode a difference between the predictive picture and an original picture. On the other hand, no data is transmitted 

so in the even cycle. 

[0123] It is to be noted that, in the case of the first embodiment, as seen from FIG. 10(A), it is impossible to carry out 
a motion prediction between the lo field and the le field, a motion prediction between the Po field and the Pe field, and 
a motion prediction between the Bo field and the Be field. 

[0124] In this case, if the prediction system of the second embodiment is employed, prediction from odd fields to even 
55 fields can be carried out in respective pictures. Namely, as shown in FIG. 12. for example, when generation of block 
data is carried out in the frame orthogonal transform mode, an approach is employed in the odd cycle to carry out DCT 
processing of respective unit blocks of a micro block MB comprised of luminance blocks YO, Y1 , Y2, Y3 of odd and even 
f ields and color difference blocks CbO, Cr1 of odd fields. Further, when generation of block data is carried out in the field 
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orthogonal transform mode, an approach is employed in the odd cycle to carry out DCT processing of respective unit 
blocks comprised of respective luminance blocks Y02o, Y13o of odd fields and respective color difference blocks CbO, 
CM of odd fields. Thereafter, an approach is employed in the even cycle to carry out DCT processing of respective unit 
blocks comprised of respective luminance blocks Y02e, Y13e of even fields. 
5 [0125] The motion prediction in the case of the example of FIG. 12 is as follows. Namely, as shown in FIG. 10(B), a 
motion prediction SMCI between the lo field and the le field, and a motion prediction SMCP between the Po field and 
the Pe field can be carried out in addition to respective motion predictions MCP, MCoPo, MCoPe, MCePo and MCePe 
of FIG. 12. 

[0126] Accordingly, in the second embodiment, for example, when generation of block data of the I frame is carried 
10 out in the frame orthogonal transform mode, an approach is employed in the odd cycle such that the lo field and the le 
field are combined, whereby the macro block is constituted. Thus, in the odd cycle, for example, DCT processing (DCT 
processing is carried out every unit block of 8x8 pixels), quantization, and variable length coding are carried out every 
macro block. On the contrary, no data is transmitted in the even cycle. 

[0127] When generation of block data is carried out in the field orthogonal transform mode, an approach is employed 
15 in the odd cycle to similarly encode only odd fields of the macro block. Thus, for example, at the time point when the 
odd cycle is completed, the entirety of the lo field and the macro block portion of the le field by the frame orthogonal 
transform mode can be obtained. Further, in the even cycle of the I frame, motion prediction is carried out with the lo 
field being as a reference picture with respect to the macro block of the I e field by the field orthogonal transform mode 
to encode a difference picture between that motion vector SMVI and the predictive picture. 
20 [0128] In the case of the P frame, processing as described below will be carried out. For example, when generation 
of block data of the P frame is carried out in the frame orthogonal transform mode and the motion prediction is carried 
out in the frame prediction mode, an approach is employed in the odd cycle to assume a reference picture to be a pic- 
ture forward in time (picture of the I frame) to detect a motion vector MVP between frames to assume the macro block 
in which lo field and le field are combined as a predictive picture to encode a difference between the predictive picture 
25 and an original picture. On the other hand, no data is transmitted in the even cycle. 

[0129] When generation of block data is carried out in the field orthogonal transform mode and the motion prediction 
is carried out in the field prediction mode, an approach is employed in the odd cycle to respectively assume the lo field 
and the le field (or Po field and Pe field) to be reference pictures to detect a motion vector MVoPo between the lo field 
and the Po field and a motion vector MVePo between the le field and the Po field to select a prediction in which a pre- 
ss dictive error between the odd or even field of a reference frame and the odd field of a current frame is minimum of the 
prediction of the odd field, prediction of the even field and the prediction obtained by the both predictions (e.g., an aver- 
age of prediction of the even field and the prediction of the odd field) to encode a difference between an original picture 
and the predictive picture. 

[01 30] On the contrary, an approach is employed in the even cycle of this mode to detect, with respect to macro blocks 
35 in the field orthogonal transform mode, a motion vector MVoPe between the lo field and the Pe field, a motion vector 
MVePe between the le field and the Pe field, and a motion vector SMVP between the Po field and the Pe field to select 
a prediction in which a predictive error is minimum from the prediction of odd fields, the prediction of even fields, and 
the prediction of the odd fields of a current frame by respective vectors (motion prediction from the Po field to carry out 
only the even cycle), and the prediction by an average of two predictions selected from the above-mentioned predic- 
40 tions, thus to encode a difference between an original picture and the predictive picture. 

[0131] Further, for example, when generation of block data of the B frame is carried out in the frame orthogonal trans- 
form mode and the motion prediction is carried out in the frame prediction mode, an approach is employed in the odd 
cycle to assume a reference picture to be pictures forward and backward in time to detect motion vectors between 
frames, i.e., a motion vector FMVB between the I frame and the B frame and a motion vector BMVB between the P 
45 frame and the B frame to select a prediction in which a predictive error between a reference frame and a current frame 
is minimum from the forward prediction, the backward prediction, and the bidirectional prediction (average of the for- 
ward prediction and the backward prediction) to encode a difference between an original picture and that predictive pic- 
ture. On the other hand, no data is transmitted in the even cycle. 

[0132] When generation of block data is carried out in the field orthogonal transform mode and the motion prediction 
50 is carried out in the field prediction mode, an approach is employed in the odd cycle to assume a reference picture to 
be pictures forward and backward in time to respectively carry out prediction of odd fields and prediction of even fields 
with respect to these pictures to detect respective motion vectors, i.e., a motion vector FMVoBo between the lo field and 
the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector BMVoBo between the Po 
field and the Bo field, and a motion vector BMVeBo between the Pe field and the Bo field. In the same manner as stated 
55 above, prediction in which a predictive error is minimum is selected to encode a difference between an original picture 
and that predictive picture. 

[01 33] Further, an approach is employed in the even cycle of this mode to carry out respective predictions by a motion 
vector FMVoBe between the lo field and the Be field, a motion vector FMVeBe between the le field and the Be field, a 
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motion vector BMVoBe between the Po field and the Be field, and a motion vector BMVeBe between the Pe field and 
the Be field in addition to prediction of odd fields of a current frame (i.e., prediction by a motion vector SMVB between 
the Bo field and the Be field) to select a prediction in which a predictive error is minimum, thus to encode a difference 
between an original picture and that predictive picture. 

5 [0134] Further, in the first embodiment, in the case of handling a digital VTR format of so called 4:2:2 component, an 
approach is employed as shown in FIG. 13 such that when the orthogonal transform mode is the frame orthogonal 
transform mode, DCT processing of respective unit blocks of a macro block comprised of luminance blocks Y0, Y1 , Y2, 
Y3 of odd and even fields and color difference blocks Cb01 , Cr01 , Cb23, Cr23 of odd and even fields is carried out. On 
the other hand, when the orthogonal transform mode is the field orthogonal transform mode, DCT processing of respec- 

io tive unit blocks of a macro block comprised of luminance blocks Y02o, Y13o of odd fields, color difference blocks 
Cb0123o, Cr0123o of respective odd fields, luminance blocks Y02e, Y13e of even fields, and color difference blocks 
Cb0123e, Cr0l23e of even fields is carried out. 

[0135] The motion prediction in the case of the example of FIG. 13 is as shown in FIG. 10(A) referred to above. As 
seen from this figure, motion prediction between the lo field and the le field, motion prediction between the Po field and 

is the Pe field, and motion prediction between the Bo field and the Be field cannot be carried out. 

[0136] Accordingly, in this case, the prediction system of the second embodiment may be used as described above. 
Namely, when generation of block data is carried out in the frame orthogonal transform mode, as shown in FIG. 13, for 
example, an approach is employed in the odd cycle to carry out DCT processing of respective unit blocks of a macro 
block comprised of luminance blocks Y0, Y1, Y2, Y3 and color difference blocks Cb01, Cr01, Cb23, Cr23 of odd and 

so even fields. Further, when generation of block data is carried out in the field orthogonal transform mode, an approach 
is employed in the odd cycle to carry out DCT processing of respective unit blocks of respective luminance blocks Y02o, 
Y13o of the odd fields and respective color difference blocks Cb0123o, Cr0123o of the odd fields. Thereafter, an 
approach is employed in the even cycle to carry out DCT processing of respective unit blocks of respective luminance 
blocks Y02e, Y13e of even fields and respective color difference blocks Cb0123e, Cr0123e of even fields. 

25 [0137] The motion prediction in the case of the above-mentioned example of FIG. 1 3 is the same as that of FIG. 1 0(B). 
[0138] Furthermore, in the first and second embodiments, in the case of handling a digital VTR format of the 4:2:2 
component, the motion prediction of frame is carried out every macro block MB as shown in FIG. 14, for example, in 
addition to processing as shown in FIG. 13 referred to above. In the case of carrying out motion prediction of field, a 
certain macro block MB (i, j*) and a macro block MB (i+1 , j) positioned therebelow may be combined into a group to carry 

30 out motion prediction of odd fields and motion prediction of even fields with respect to the group of these macro blocks 
MBg. 

[01 39] The extracted diagram of a macro block of a portion of the frame in the case of the example of FIG. 1 4 is shown 
in FIG. 15. In FIG. 15, the processing is assumed to proceed in a direction indicated by arrows. Namely, in FIG. 15, a 
subsequent macro block MB (i, j+1) relative to a certain macro block MB (i, j) and macro blocks Mb (i+1 , j) and MB (i+1 , 

35 j+1) positioned therebelow (of the next line) are indicated. 

[0140] In a macro block as shown in FIG. 15, for example, in the case of the frame orthogonal transform mode, 
respective luminance blocks YO, Y1 and color difference blocks Cb01, Cr01 are subjected to DCT processing every 
respective macro blocks MB (i, j), MB (i, j+1), • • • , MB (i+1 , j), MB (i+1 , j+1) • • • . For this reason, in the case of the 
frame orthogonal transform mode, the processing of respective macro blocks are not affected by the processing modes 

40 of other macro blocks. 

[0141] On the contrary, in the case of the field orthogonal mode, an approach is employed as shown in FIG. 16 to 
divide a macro block constituting the set MBg of macro blocks into a macro block MBgo of odd field and a macro block 
MBge of even field to carry out DCT processing of luminnace blocks YOo, Y1 o and color difference blocks Cb01 o, Cr01 o 
in the macro block MBgo of odd field. 

45 [0142] Assuming now that, e.g., the set MBg of macro blocks consist of macro blocks Mb (i, j) and MB (i+1 , j) of FIG. 
15, luminance block YOo, Y1o in the macro block MBgo of odd field in the macro block MBg consist of luminance blocks 
of odd fields of the macro block MB (i, j) and luminance blocks of odd fields of the macro block MB (i+1 , j). Further, color 
difference blocks Cb01o, Cr01o in the macro block MBgo of odd fields similarly consist of color difference blocks of odd 
fields of the macro block MB (i, j) and color difference blocks of odd fields of the macro block MB (i+1, j). 

so [0143] In a manner similar to the above, luminance blocks YOe, Y1e in the macro block MBge of even fields consist 
of luminnace blocks of even fields of the macro block MB (i, j) and luminance blocks of even fields of the macro block 
MB (i+1 , j). Further, color difference blocks Cb01e, Cr01 e in the macro block MBge of even f ields consist of color differ- 
ence blocks of even fields of the macro block MB (i, j) and color difference blocks of even field of the macro block MB 

55 [0144] From the fact as described above, the relationship between the motion prediction and respective DCT process- 
ing is as described below. Namely, in the coding apparatus of this embodiment, in the case where the motion prediction 
is carried out in the frame orthogonal transform mode and DCT processing is carried out in the frame orthogonal trans- 
form mode with respect to, e.g., the macro block MB (i, j), a picture decoded in the group of frame memories 20 with a 
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motion compensator is assumed to be a reference frame to carry out DCT processing of a difference between a predic- 
tive picture taken out from the reference frame and an input picture (original picture). Then, DCT coefficients and frame 
motion vectors are transmitted. 

[0145] Moreover, for example, in the macro block MB (i, j), in the case of the motion prediction in the field orthogonal 
5 transform mode and DCT processing in the field orthogonal transform mode, at this macro block MB (i, j) a difference 
between a predictive picture taken out form odd fields and an original picture of odd fields and motion vectors of odd 
fields are coded. Further, at the macro block MB (i+1 , j) a difference between a predictive picture taken from even fields 
and an original picture of even fields, and motion vectors of even fields are coded. 

[0146] Further, for example, in the macro block MB (i, j), in the case of the motion prediction in the field orthogonal 
io transform mode and the DCT processing in the frame orthogonal transform mode, at this macro block MB (i, j), a frame 
difference between a predictive picture with respect to the position of the macro block MB (i, j) taken out from a refer- 
ence frame and an input picture, motion vectors of odd fields, and motion vectors of even fields are transmitted. More- 
over, at the macro block MB (i+1, j), a frame difference between a predictive picture with respect to the position of the 
macro block MB (i+1 , j) taken out from a reference frame and an input picture is transmitted. 
15 [0147] Further, for example, in the macro block MB (i, j), in the case of the motion prediction in the frame orthogonal 
transform mode and the DCT processing in the f ield orthogonal transform mode, at this macro block MB (i, j), a differ- 
ence between a predictive picture taken out from odd fields and an original picture of odd fields, frame motion vectors 
of the macro block MB (i, j), and frame motion vectors of the macro block MB (i+1 , j) are transmitted. In addition, at the 
macro block MB (i+1, j), a difference between a predictive picture of odd fields and an input picture is transmitted. 
20 [0148] Meanwhile, in this coding apparatus, an approach is employed to add expansion bits to the conventional macro 
block type to allow this apparatus to be compatible with conventional apparatuses, thereby realizing this coding system 
(format). 

[0149] Namely, in the case of the first embodiment, for example, in the B frame, there are three prediction systems of 
the forward prediction, the backward prediction, and the bidirectional prediction as the macro block type. With respect 

25 to the forward prediction, when the prediction mode is the field prediction mode, two kinds of predictions from an odd 
field and an even field of a former frame are conceivable. Accordingly, by adding an expansion bit for recognizing 
whether a prediction employed is any of two kinds of predictions, the coding format of this invention is realized. Since 
there are two kinds of predictions in this case, it is sufficient to add one bit as expansion bit with respect to one direction 
(forward or backward prediction). For example, in the forward or backward prediction, in the case of prediction from an 

30 odd field, it is sufficient to add, as an expansion bit, code "1 " to the conventional macro block type; and in the case of 
prediction from an even field, to add, as an expansion bit, code "0" to the conventional macro block type. In addition, in 
the case of the bidirectional prediction, bidirectional expansion bits are added with respect to the forward or backward 
prediction. 

[0150] It is to be noted that if the prediction mode is the frame prediction mode, no expansion bit is added to adopt 
35 the same form as that of a conventional bit stream. 

[01 51] This may similarly apply to the case of the P frame. 

[0152] In the case of the second embodiment, for example, in the B frame, there are forward prediction, backward 
prediction, and bidirectional prediction as described above as the macro block type. With respect to the forward predic- 
tion, at the time of the field prediction mode, an expansion bit for recognizing whether a prediction employed is predic- 

40 tion from an odd field, prediction from an even field, or prediction from an odd field in a current frame must be added to 
the macro block type. Namely, in the field prediction mode of the forward prediction, since there is prediction from in the 
current frame, an expansion bit of one or two bits is required in order to represent three kinds of predictions including 
predictions from odd and even fields with an expansion bit On the other hand, in the field prediction mode of the back- 
ward prediction, since there are only two kinds of predictions from odd and even fields, one bit is always required as an 

45 expansion bit. Namely, it is sufficient to add the following codes to the conventional macro block type as an expansion 
bit depending upon the kind of predictions. For example, in the forward prediction, in the case of prediction from an odd 
field of a former frame, code "1" is added; in the case of prediction from an even field of a former frame, code "01" is 
added; and in the case of prediction from an odd field of a current frame, code "11" is added. On the other hand, in the 
backward prediction, in the case of prediction from an odd field of a later frame, code "1" is added; and in the case of 

so prediction from an even field of a later frame, code "0" is added. 

[0153] It is to be noted that if the prediction mode is the frame prediction mode, no expansion bit is added to adopt 
the same form as that of the conventional bit stream (MPEG). In addition, in the case of the bidirectional prediction, bidi- 
rectional expansion bits are added with respect to the forward or backward prediction. 
[0154] This may similarly apply to the case of the P frame. 

55 [0155] Further, a scheme may be employed as a modification thereof to reduce the number of expansion bits in the 
case of the forward prediction to one bit. Namely, in the even cycle in the field prediction mode, as shown in FIG. 17, 
prediction from an odd field of a former frame having the maximum time difference relative to a current frame is abol- 
ished to thereby reduce the number of forward prediction modes to two, thus making it possible to transmit the forward 
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put of the group of frame memories 20 with motion compensator are added. It is to be noted that a signal for preventing 
an overflow of the buffer 16 is fed back from the buffer 16 to the quantizer 14 as indicated by dotted lines. 
[0076] On the other hand, picture data outputted every macro block from the group of frame memories 10 is sent to 
the frame motion detector 22 and the field motion detector 21 . 
s [0077] The field motion detector 21 detects, every macro block, motion vectors between fields and a sum of differ- 
ences between absolute values of respective pixels, thus to output these data (data FDMV of the motion vectors 
between fields and data FDAD of the sum of the differences between absolute values). 

[0078] Further, the frame motion detector 22 detects, every macro block, motion vectors between frames and a sum 
of differences between absolute values of respective pixels, thus to output these data (data FMM V of the motion vectors 
io between frames and data FMAD of the sum of differences between absolute values). 

[0079] Data FMMV/FDMV of respective motion vectors of these motion detection circuits 22 and 21 are transmitted 
to the selector 24, and data FM AD/FDAD of sums of differences between respective absolute values are transmitted to 
a-prediction mode judgment circuit 23. 

[0080] This motion prediction mode judgment circuit 23 carries out Judgment whether the motion predictive process- 
75 ing is carried out every field, or the motion predictive processing is carried out every frame in the motion predictive 
processing at the group of frame memories 20 with motion compensator (of which operation will be described in detail 
later) on the basis of the data FDAD of the sum of differences between absolute values from the field motion detector 
21 and the sum of differences between absolute values from the frame motion detector 22, thus to output data indicat- 
ing a processing mode of a more advantageous processing (of a higher efficiency). 
20 [0081] To speak in a practical manner, in the case where it is judged at the motion predictive mode judgment circuit 
23 that, e.g., a difference between data FMAD of a sum of differences between absolute values and data FDAD of a 
sum of differences between absolute values is greater than a certain threshold value T1 (when FMAD-FDAD>T1 ), data 
indicating that the method of carrying out the motion predictive processing every field has a higher efficiency (data 
MPFD in the field orthogonal transform mode in the motion prediction) is outputted from the circuit 23. 
25 [0082] In contrast, in the case where it is judged that a difference between data FMAD of a sum of differences 
between absolute values and data FDAD of a sum of differences between absolute values is smaller than the threshold 
value T1 or equal thereto (when FMAD-FDAD<T1), data indicating that the method of carrying out the motion predictive 
processing every frame has a higher efficiency is outputted. 

[0083] Any one of these motion predictive mode data MPFM/MPFD is sent to the group of frame memories 20 with 
30 motion compensator. Thus, the group of frame memories 20 carries out motion compensation every frame or every 
field. Further, any one of these motion predictive mode data MPFM/MPFD is also sent to the selector 24. 
[0084] This selector 24 selectively outputs, in dependency upon the motion predictive mode data MPFM/MPFD from 
the motion predictive mode judgment circuit 23, either data FMMV of motion vectors between frames delivered from the 
frame motion detector 22 or data FDMV of motion vectors between fields delivered from the field motion detector 21 . 
35 Namely, when the motion predictive mode data is data MPFD indicating the field predictive mode, the selector 24 
selects and outputs motion vector data FDMV from the field motion detector 21 , and when the motion predictive mode 
data is data MPFM indicating the frame predictive mode, the selector 24 selects and outputs motion vector data FMMV 
from the frame motion detector 22. 

[0085] The motion vector data FMMV/FDMV selected at the selector 24 is sent to the block data generation mode 
40 judgment circuit 25. 

[0086] To the block data generation mode judgment circuit 25, output data from the group of frame memories 1 0 and 
the processing mode data MPFM/MPFD from the motion predictive mode judgment circuit 23 are also delivered. This 
block data generation mode judgment circuit 25 receives the motion predictive mode data MPFM/MPFD and the motion 
vector data FMMV/FDMV, and further prepares difference picture data by using picture data from the group of frame 
45 memories 1 0 to select, on the basis of the difference picture data, a block data generation mode most suitable for a pic- 
ture which is outputted from the group of frame memories 1 0 and is subjected to DCT processing at the DCT circuit 13. 
[0087] It is to be noted that, in the case of the I picture (or I frame), data of a picture (original picture) of the group of 
frame memories 10 is used in place of the difference picture data. 

[0088] Namely, it is now assumed that, e.g., a macro block of the difference picture is a macro block as shown in FIGS. 

so 5(A), for example (macro block of an original picture in the I picture). 

[0089] In FIG. 5(A), odd lines (o1 , o2, o3, ... oN, N is equal to 16 in the case of the macro block) are indicated by solid 
lines, and even lines (e1 , e2, e3. ... eN, N is equal to 16 in the case of the macro block) are indicated by dotted lines. 
Further, respective pixels of even lines are represented by e(i.j), and respective pixels of odd lines are represented by 
o(i,j). In a difference picture or original picture (picture of the. I picture) as shown in FIG. 5(A), a difference EFD of the 

55 difference picture every field can be expressed by the following formula (1). and the difference EFM of the difference 
picture every frame can be expressed by the following formula (2). 
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prediction mode by expansion of one bit. Namely, it is sufficient to add the following codes to the conventional macro 
block type as an expansion bit depending upon the kind of predictions. In actual terms, in the forward prediction in the 
odd cycle, in the case of prediction from an odd field of a former frame, code "1" is added; and in tic case of prediction 
from an even field of a former frame, code "0" is added. Further, in the forward prediction in the even cycle, in the case 
5 of prediction from an odd field of a current frame, code "1 " is added; and in the case of prediction from an even field of 
a former frame, code "0" is added. In addition in the forward prediction, in the case of prediction from an odd field of a 
later frame, code "1" is added; and in the case of prediction from an even field of a later frame, code "0" is added. 

[Description of the third embodiment] 

w * 

[01 56] FIG. 3 shows an efficient coding apparatus for a picture signal of a third embodiment. In FIG. 3, blocks to which 
the same reference numerals as those of FIG. 1 are attached have the same functions of those of the blocks of FIG. 1 , 
respectively. Accordingly, explanation will be given in connection with blocks to which reference numerals different from 
those of FIG. 1 are attached. 

" 75 [01 57] Namely, the efficient coding apparatus of FIG. 3 comprises a mode judgment circuit 33 and selector 24 serving 
as mode selection means for judging, by using information outputted from the motion detection means, which any one 
of an efficiency in the case where the motion compensation is carried out in the frame prediction mode and generation 
of block data for orthogonal transform processing is carried out in the frame orthogonal transform mode and an effi- 
ciency in the case where motion compensation is carried out in the field prediction mode and generation of block data 

20 for orthogonal transform processing is carried out in the field orthogonal transform mode has a higher value, thus to 
select a prediction mode of a higher efficiency; and an address generator 35 serving as address generation means 
adapted for recognizing whether a current cycle is an odd cycle of a time period during which scan of odd fields is car- 
ried out or an even cycle during which scan of even fields is carried out in an interlaced scan of coding processing with 
respect to one frame (one picture) to control a group of frame memories so as to sequentially output, by one frame, odd 

25 fields of macro blocks in the odd cycle only when the mode of the mode judgment circuit 33 is the mode for the field 
prediction/field processing, thereafter to sequentially output, by one frame, even fields of macro blocks in the even 
cycle. 

[0158] The efficient coding apparatus for a picture signal of the third embodiment shown in FIG. 3 further comprises, 
in addition to the motion detection means and the frame/field mode judgment circuit 33, a coding processing mode judg- 

30 ment circuit 34 serving as third mode selection means for judging which any one of a first coding processing mode for 
adaptively switching generation of block data for orthogonal transform processing into the frame orthogonal transform 
mode or the field orthogonal transform mode every respective macro blocks in one frame to encode respective macro 
block data on the basis of a mode obtained by switching and a second coding processing mode for carrying out gener- 
ation of block data for orthogonal transform processing of all macro blocks in one frame in the field orthogonal transform 

35 mode to encode, by one frame, only odd fields comprised of macro blocks in an odd cycle of a time period during which 
scan of odd fields in an interlaced scan is carried out thereafter to encode, by one frame, even fields comprised of 
macro blocks in an even cycle of a time period during which scan of even fields in the interlaced scan is carried out has 
a higher efficiency in coding processing, thus to select a coding processing mode of a higher efficiency. 
[0159] As described above, the apparatus of this embodiment comprises the address generator 35 for recognizing 

ao whether a current cycle is the odd cycle or the even cycle, whereby when the coding processing mode is the first coding 
processing mode, the address generator 35 controls the group of frame memories 10 so as to output macro block data 
generated in correspondence with the block data generation mode for orthogonal transform processing in the odd cycle, 
while when the coding processing mode is the second coding processing mode, the address generator 35 controls the 
group of frame memories 10 so as to output macro block data generated in correspondence with the field orthogonal 

45 transform mode in the odd cycle and the even cycle. 

[0160] In the coding apparatus of this embodiment, which any of the frame motion prediction mode and the field 
motion prediction mode has a higher efficiency in carrying out motion compensation can be selected by the above- 
described first mode selection means. Further, which any one of the frame orthogonal transform mode and the field 
orthogonal transform mode has a higher efficiency in carrying out orthogonal transform processing can be selected by 

50 the second mode selection means. In this embodiment, selection of the first and second modes is carried out by the 
above-described frame/field mode judgment circuit 33. 

[0161 ] Further, the apparatus of this embodiment carries out mode selection processing by the first and second mode 
selection means, and carries out coding processing in any one of two coding processing modes of a higher efficiency 
with respect to respective frames. Namely, as described above, in the first coding processing mode, switching between 
55 the frame orthogonal transform mode and the field orthogonal transform mode is adaptively carried out every respective 
macro blocks in one frame, thus to encode respective macro block data. 

[0162] In addition, as described above, in the second coding processing mode, an approach is employed to carry out, 
in the field orthogonal transform mode, generation of block data for orthogonal transform processing of all macro blocks 
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in one frame to encode, by one frame, only odd fields in macro block data in the odd cycle of a time period during which 
scan of odd fields (first fields) is carried out thereafter to encode, by one frame, even fields in macro block data in the 
even cycle of a time period during which scan of even fields (second fields) is carried out. The third mode selection 
means is used to judge which any one of the first and second coding processing modes has a higher efficiency in cod- 

5 ing, thus to select a coding processing mode of a higher efficiency. 

[0163] Namely, in the first coding processing mode, there is carried out a processing to adaptively conduct switching 
between a mode for encoding block data every frame without dividing each frame into a first field (odd field) and a sec- 
ond field (even field) (the above-mentioned frame orthogonal transform mode) and a mode in which each frame is 
divided into first and second fields to encode block data every field (the above-mentioned field orthogonal transform 

io mode) such that the frame orthogonal transform mode is used in a macro block in which, e.g., movement of picture is 
small, and that the field orthogonal transform mode is used in a macro block in which, e.g., movement of picture is great. 
[0164] Accordingly, in the case where the frame orthogonal transform mode is selected in the first coding processing 
mode, e.g., in the motion prediction of P and B frames, a motion prediction is carried out from frames forward and back- 
ward in time, whereby a difference picture between an original picture and a predictive picture is subject to orthogonal 

75 transform (OCT) processing. Moreover, in the case where the field orthogonal transform mode is selected in the first 
coding processing mode, for example, in the motion prediction of P and B frames, motion prediction is carried out from 
the first or second field of frames forward and backward in time with respect to the first and second fields of macro block 
data, whereby a difference picture between an original picture and a predictive picture thus obtained is subjected to 
DCT processing. From such facts, it can be said that the first coding processing mode is a coding in which there is no 

20 interf ield prediction in a frame. Additionally, in this first coding processing mode, coding processing is carried out in the 
odd cycle. 

[0165] In the above-mentioned first coding processing mode, motion prediction between respective fields in a frame 
(between an odd field and an even field in the same frame) cannot be carried out. 

[0166] Accordingly, in the second coding processing mode of this embodiment, as described above, an approach is 

25 employed to carry out generation of block data for orthogonal transform processing of all macro blocks in respective 
frames in the field orthogonal transform mode to encode, by one frame, only odd fields in macro block data in the odd 
cycle thereafter to encode, by one frame, even field in macro block data in the even cycle. Accordingly, in accordance 
with the second coding processing mode, since the odd field (first field) is coded first, motion prediction of the even field 
(second field) can be carried out from the odd field (first field). From such fact, it can be said that the second coding 

30 processing mode is a coding of frame in which there is an interf ield prediction in a frame. 

[0167] Turning back to FIG. 3 for a second time the selector 24 selectively outputs, in dependency upon motion pre- 
dictive mode data MPFM/MPFD from the frame/field mode judgment circuit 33, any one of data FMMV of motion vec- 
tors between frames delivered from the frame motion detector 22 and data FDMV of motion vectors between fields 
delivered from the field motion detection circuit 21. Namely, when the motion predictive data is data MPFD indicating 

35 the field motion predictive mode, the selector 24 selects and outputs motion vector data FDMV from the field motion 
detector 21, while when the motion predictive mode data is data MPFM indicating the frame motion predictive mode, 
the selector 24 selects and outputs motion vector data FMMV from the frame motion detector 22. 
[0168] The motion vector data FMMV/FDMV selected at the selector 24 is sent to the group of frame memories 20 
with motion compensator. Thus, this group of frame memories 20 can carry out motion compensation every frame or 

40 every field on the basis of the motion predictive mode data MPFM/MPFD and the motion vector data FMMV/FDMV. 
[01 69] In addition, to the frame/field mode judgment circuit 33, picture data every macro block read out from the group 
of frame memories 10 is also delivered. This frame/field mode judgment circuit 33 carries out, at the same time, a 
processing to prepare a difference picture by using the motion predictive mode data MPFM/MPFD and the motion vec- 
tor data FMMV/FDMV, and picture data from the group of frame memories 10 to select, on the basis of the difference 

45 picture, a mode of processing for generating block data for orthogonal transform most suitable for a picture outputted 
from the group of frame memories 10 and subjected to DCT processing at the DCT circuit 13. It is to be noted that, in 
the case of the I picture (or I frame), data of a picture (original picture) of the group of frame memories 10 is used in 
place of the difference picture. 

[0170] The frame/field mode judgment circuit 33 outputs data MDFD of the field orthogonal transform mode in the 
so processing for generating block data for orthogonal transform processing, or outputs data MDFM of the frame orthogo- 
nal transform mode in the processing for generating block data for orthogonal transform processing. 
[0171] Here, an output of the frame orthogonal transform mode data MDFM or field orthogonal transform mode data 
MDFD from the frame/field mode judgment circuit 33 is caused to be in correspondence with coding mode data 
EN1/EN2 corresponding to the first coding processing mode or the second coding processing mode from the coding 
55 processing mode judgment circuit 34. 

[0172] This coding processing mode judgment circuit 34 judges, by using picture data every macro block read out 
from the group of frame memories 10, which any one of the first and second coding processing modes has a higher 
efficiency in coding to output the coding mode data EN1 or EN2 corresponding to the judged result. In actual terms, the 
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luminance component as described later) are outputted at a time. To speak in a practical sense, in the odd cycle, the 
add? ess generator 35 controls the group of frame memories 1 0 so that macro block data of two blocks of 8x8 only in the 
odd field is outputted by one frame (one picture). In the subsequent even cycle, the address generator 35 controls the 
group of frame memories 10 so that macro block data of two blocks of 8x8 only in the even field are outputted by one 
5 frame (one picture). 

[0182] Picture data outputted from the group of frame memories controlled by the address generator 35 in a manner 
as described above is subjected to DCT processing at the DCT circuit 1 3 as previously described. Namely, for example, 
in the case where the first coding processing mode is selected and the frame orthogonal transform mode is selected, 
this DCT circuit 13 carries out DCT processing at unit block of 8 pixels as shown in FIG. 5(B) referred to above. Further, 

10 for example, in the case where the first coding processing mode is selected and the field orthogonal transform mode is 
selected, the DCT circuit 13 carries out DCT processing at unit block of 8x8 pixels as shown in FIG. 5(C) referred to 
above. In addition, in the case where the second coding processing mode is selected, as described above, when the 
processing cycle is the odd cycle, only odd fields are subjected to DCT processing at unit block of 8x8; and when the 
processing cycle is the even cycle, only even fields are subjected to DCT processing at unit block of 8x8 only. 

is [0183] Further, motion predictive mode data MPFM/MPFD and orthogonal transform mode data MDFM/MDFD from 
the frame/field mode judgment circuit 33, motion vector data FMMV/FDMV selected at the selector 24, and coding 
mode data EN1/EN2 from the coding processing mode judgment circuit 34 are delivered also to the group of frame 
memories 20 with motion compensator. Accordingly, at the group of frame memories 20 with motion compensator, there 
is carried out a motion compensation corresponding to motion predictive mode data MPFM/MPFD in the motion predic- 

20 tion, orthogonal transform mode data MDFM/MDFD in the DCT processing and coding mode data EN1/EN2, and using 
the motion vector data FMMV/FDMV. 

[0184] From facts as described above, the motion prediction of, e.g., P and B frames in the case of the first coding 
processing and the frame orthogonal transform mode is subjected to motion prediction from former and later frames as 
shown in FIG. 6. Accordingly, at the DCT circuit 13, a difference picture between an original picture and the predictive 

25 picture is subjected to DCT processing (subjected to DCT processing at unit block of 8x8 pixels). In FIG. 6, a former 
frame, a current frame and a later frame are shown, arrow indicates a motion vector, and MB indicates a macro block 
[0185] Further, in the motion prediction of P and B frames in the case of the first coding processing mode and the field 
orthogonal transform mode, motion prediction is carried out from odd or even field (first or second field) of the 
former/later frames with respect to the odd and even fields of the macro block as shown in FIG. 7. Accordingly, at the 

30 DCT circuit 13, a difference picture between an original picture and the predictive picture is subjected to DCT process- 
ing (subjected to DCT processing at unit block of 8x8 pixels). In FIG. 7, an odd field and an even field of former, current 
and later frames are shown. In this figure, arrow indicates a motion vector, and MB indicates a macro block. 
[0186] Further, the motion prediction at the time of the f ield orthogonal transform mode in the case of the second cod- 
ing processing mode is carried out as shown in FIG. 8, for example. Namely, motion prediction is carried out from odd 

35 or even fields of former/later frames with respect to odd and even fields of the macro block, and motion prediction 
between respective fields in each frame is also carried out. Accordingly, at the DCT circuit 13, a difference picture 
between an original picture and the predictive picture is subjected to DCT processing (subjected to DCT processing at 
unit block of 8x8 pixels). In FIG. 8, respective odd and even fields of former, current and later frames are shown. In this 
figure, arrow indicates a motion vector and MB indicates a macro block. 

40 [0187] From facts as described above, in the efficient coding apparatus for a picture signal of the third embodiment, 
switching between coding in which interfield prediction in a frame is not carried out and coding in which interfield pre- 
diction in a frame is carried out is conducted in dependency upon the first or second coding processing mode (i.e., the 
quantity of movement of picture). Accordingly, coding having the highest efficiency can be made. Particularly, in the 
case of a frame in which movement is great, the second coding processing mode is effective. 

45 [0188] Further, in this embodiment, with respect to one frame, coding processing is divided into the odd cycle of a 
time period during which scan of odd fields in an interlaced scan is carried out and the even cycle of a time period during 
which scan of even fields in the interlaced scan is carried out. 

[0189] From facts as described above, as shown in FIG. 1 1 , in the case of the motion prediction of P and B frames in 
the first coding processing mode, processing similar to that of the first embodiment is carried out. 

so [0190] Further, when the coding processing mode is the first coding processing mode, generation of block data for 
orthogonal transform processing of the B frame is carried out in the field orthogonal transform mode, and the motion 
prediction is carried out in the frame motion prediction mode, an approach is employed in the odd cycle to assume a 
reference picture to be pictures forward and backward in time to detect motion vectors between frames, i.e., a motion 
vector FMVB between the I frame and the B frame and a motion vector BMVB between the P frame and the B frame to 

55 select a prediction in which a predictive error between a reference frame and a current frame is minimum of the forward 
prediction, the backward prediction and the bidirectional prediction (average of the forward prediction and the backward 
prediction) to assume, as a predictive picture, the macro block constructed so that the odd field and the even field are 
separate with each other to encode a difference between the predictive picture and an original picture. 
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[0191] Moreover, when the coding processing mode is the first coding processing mode, generation of block data for 
orthogonal transform processing of the B frame is carried out in the field orthogonal transform mode, and the motion 
prediction is carried out in the field motion prediction mode, an approach is employed in the odd cycle to assume a ref- 
erence picture to be pictures forward and backward in time to carry out prediction of the odd field and prediction of the 

5 even field with respect to these pictures to detect respective motion vectors, i.e., a motion vector FMVoBo between the 
lo field and the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector FMVoBe 
between the lo field and the Be field, a motion vector FMVeBe between the !e field and the Be field, a motion vector 
BMVoBo between the Po field and the Bo field, a motion vector BMVeBo between the Pe field and the Bo field, a motion 
vector BMVoBe between the Po field and the Be field, and a motion vector BMVeBe between the Pe field and the Be 

70 field to select a prediction in which a predictive error between a reference frame and a current frame is minimum of the 
prediction of the odd field, the prediction of the even field, and the bidirectional prediction by respective vectors (average 
of the prediction of the even field and the prediction of the odd field) to assume, as a predictive picture, the macro block 
constructed so that the lo field and the le field (or the Po field and the Pe field) are separate with each other to encode 
a difference between the predictive picture and an original picture. On the other hand, no data is transmitted in the even 

75 cycle of this mode. 

[0192] It is to be noted that, in the case of the first coding processing of this embodiment, similarly to the case of the 
first embodiment, the motion prediction between the lo field and the le field, the motion prediction between the Po field 
and the Pe field, and the motion prediction between the Bo field and the Be field cannot be carried out. 
[0193] In this case, if the second coding processing mode of this embodiment is used, prediction from the odd field 

20 to the even f ield can be made in respective pictures. 

[0194] Accordingly, in the case where the processing mode is the second coding processing mode and the orthogonal 
transform mode is the field orthogonal transform mode, an approach is employed to encode, in the odd cycle, only odd 
fields of macro block data, and to encode, in the even cycle, only even lields of macro block data. Thus, at the time point 
when, e.g., the above-mentioned odd cycle is completed, the entirety of the lo field is obtained on the decoder side 

25 which will be described later. Accordingly, in the even cycle of the I frame, with respective to macro block data of the le 
field by the field orthogonal transform mode, as shown in FIG. 11, motion prediction is carried out by using the lo field 
as a reference picture, thus making it possible to encode that motion vector SMVI and a difference picture between an 
original picture and the predictive picture. 

[0195] Further, as shown in FIG. 11, in the case of the P frame in the second coding processing mode, processing 
30 as described below will be conducted. For example, when the motion prediction mode of the P frame is the frame 
motion prediction mode, an approach is employed to detect a motion vector MVP between frames with a reference pic- 
ture being as a picture forward in time (picture of I Irame) after the odd cycle and the even cycle to assume, as a pre- 
dictive picture, the macro block in which the lo field and the le field are combined to encode a difference between the 
predictive picture and an original picture. 
35 [0196] When the coding processing mode is the second coding processing mode and the motion prediction of the P 
frame is carried out in the field motion prediction mode, an approach is employed in the odd cycle to detect a motion 
vector MVoPo between the lo field and the Po field and a motion vector MVePo between the le field and the Po field with 
the lo field and the le field being as reference pictures, respectively. 

[0197] In the even cycle of this mode, an approach is employed to detect, with respect to macro block data of the field 

ao orthogonal transform mode, a motion vector MVoPe between the lo field and the Pe field, a motion vector MVePe 
between the le field and the Pe field, and a motion vector SMVP between the Po field and the Pe field to select a pre- 
diction in which a predictive error is minimum from the prediction of the odd field, the prediction of the even field and the 
prediction of the odd field of a current frame by respective vectors, and the prediction by an average of two predictions 
selected therefrom, thus to encode a difference between an original picture and the predictive picture. 

45 [0198] Further, for example, when the coding processing mode is the second coding processing mode and the motion 
prediction of the B frame is carried out in the frame motion prediction mode, an approach is employed to detect a motion 
vector FMVB between the I frame and the B frame, and a motion vector BMVB between the P frame and the B frame 
to select a prediction in which a predictive error between a reference frame and a current frame is minimum of the for- 
ward prediction, the backward prediction, and the bidirectional prediction (average of the forward prediction and the 

so backward prediction), thus to encode a difference between an original picture and the predictive picture. 

[0199] When the coding processing mode is the second coding processing mode and the motion prediction of the B 
frame is carried out in the field motion prediction mode, an approach is employed in the odd cycle to assume a refer- 
ence picture to be pictures forward and backward in time to carry out the prediction of the odd field and the prediction 
of the even field with respect to these pictures to detect respective motion vectors, i.e., a motion vector FMVoBo 

55 between the lo field and the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector 
BMVoBo between the Po field and the Bo field, and a motion vector BMVeBo between the Pe field and the Bo field. 
[0200] The motion prediction in the first coding processing mode in the case of the example of FIG. 3 is as shown in 
FIG. 10(A) referred to above. Accordingly, in this case, as described above, it is sufficient to use the second coding 
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processing mode. 

[0201] In addition, also in this embodiment, in the case of handling digital VTR format of 4:2:2 component, the motion 
predictive processing of frame is carried out every macro block MB as shown in FIG. 14 referred to above in addition to 
processing as shown in FIG. 13 referred to above. On the other hand, in the case of carrying out motion prediction of 
5 field, an approach may be employed to combine macro blocks as a group to carry out motion prediction of the odd field 
and motion prediction of the even field with respect to the group of macro blocks MBg. Thus, in the case of the frame 
orthogonal transform mode, processing of respective macro blocks are not affected by the orthogonal transform mode 
of other macro blocks. 

[0202] An example of the configuration of a coding apparatus of a fourth embodiment is shown in FIG. 18. In FIG. 18, 
w the same reference numerals are respectively attached to components similar to those of FIG. 1 referred to above, and 
their detailed explanation will be omitted. 

[Description of the fourth embodiment] 

15 [0203] The apparatus of the fourth embodiment is constructed as a coding apparatus by three passes wherein three 
times of processing are carried out for processing one frame. 

[0204] Namely, in the apparatus of the fourth embodiment, at the first pass, processing of the second coding process- 
ing mode (mode having an interfield prediction in a frame) by the fixed quantization width is carried out; at the second 
pass, processing of the first coding processing mode (mode having no interfield prediction in a frame) by the fixed quan- 
go tization width is carried out; and at the third pass, a processing having a lesser number of bits generated of the process- 
ing at the first and second passes is selected to carry out the selected processing so as to control the quantization 
width. 

[0205] In the apparatus of the fourth embodiment, at the succeeding stage of the group of frame memories 10, a 
macro block data generator 55, a selector switch 57, a circuit 56 for transforming macro block data to field block data 

25 (hereinafter referred to as a field block data generator depending upon circumstances), and a selector switch 58 are 
inserted and connected. In addition, picture data from the group of frame memories 10 is sent to a motion detector 51 
for carrying out frame and field motion detections. An output from the motion detector 51 is sent to a mode judgment 
circuit 52 for selecting frame/field mode in generation of block data for orthogonal processing and the motion prediction, 
the group of frame memories 20, and the variable length coding circuit 15. 

30 [0206] Output mode data from the mode judgment circuit 52 is sent to the group of frame memories 20 and the vari- 
able length coding circuit 15, and field orthogonal transform mode data thereof is sent to one input terminal of a two- 
input AND gate 53. To the other input terminal of the two-input AND gate 53, an output of a selector switch 59 switched 
in dependency upon whether a current processing is processing of the first, second or third pass is delivered through 
an inverter 54. In addition, the output terminal of the two-input AND gate 53 is connected to switching control terminals 

35 of the selector switches 57, 58. 

[0207] From the variable length coding circuit 1 5, data indicating the number of bits generated is outputted. This data 
indicating the number of bits generated is sent to a selection circuit (circuit for judging whether or not there is interfield 
prediction in a frame) 60 for selecting a mode of a lesser number o1 bits generated of the first and second coding 
processing modes on the basis of the data indicating number of bits generated and to a buffer 16. Further, data of a 

40 quantity of storage from the buffer 16 is delivered to the variable coding circuit 15, and to one selected terminal of a 
selector switch 61 . To the other selected terminal of this selector switch 61 , fixed values of the first and second passes 
are delivered. 

[0208] In such an apparatus of the fourth embodiment, picture data inputted to the terminal 1 is temporarily stored 
into the group of frame memories 1 0. From the group of frame memories 1 0, necessary frame or field data are read out. 

45 By using these picture data thus obtained, motion vectors are determined by the motion detector 51 . The above-men- 
tioned mode judgment circuit 52 carries out judgment of the mode of field/frame every macro block from a motion pre- 
diction residual from the motion detector 51 . The macro block data generator 55 connected to the succeeding stage of 
the group of frame memories 10 receives information corresponding to processing of the first, second and third passes 
(i.e., information of presence/absence of interfield prediction in a frame which is the first coding processing mode or the 

so second coding processing mode). When the macro block data generator 55 receives information of the second coding 
processing mode as the above information, it transmits only block data of the odd field (first field) thereafter to transmit 
block data of the even field (second field) to stop generation of block data in the frame orthogonal transform mode. In 
addition, in the case where picture data in which macro block data is caused to be block data in the frame orthogonal 
transform mode on the basis of information of the first coding processing mode at the macro block data generator 55 is 

55 judged to be data in the field mode at the mode judgment circuit 52 from a residual from the motion detector 51 , this 
data is transformed to block data in the field orthogonal transform mode at the circuit 56 for transforming input data into 
field block data. 

[0209] At the processing of the first and second passes, coding is carried out by each fixed quantization width. At the 
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selection circuit 60, comparison between respective quantities of bits generated is conducted. In dependency upon the 
comparison result, a mode of a lesser quantity of bits generated is selected every frame of the processing modes hav- 
ing interfield prediction in a frame and the processing having no such prediction. At the processing of the third pass, 
actual coding is carried out. To information of a mode selected at this time, 1 bit is added every frame. 

5 [021 0] As described above, in accordance with the efficient coding apparatus for a picture signal, even if, with respect 
to a moving picture of the field structure, a picture to be coded is a picture having small movement or a picture having 
great movement, or a picture in which such pictures are mixed, it becomes possible to efficiently implement field 
processing or frame processing thereto. Accordingly, it is possible to reproduce, with a lesser quantity of information 
transmitted, a moving picture of a high picture quality in decoding in the efficient decoding apparatus of which operation 

io will be described in detail later. 

[Description of the embodiment of decoder] 

[021 1 ] The block diagram of a decoder for a picture signal is shown in FIG. 1 9. Data coded by the above-mentioned 
75 coding apparatus is recorded onto a storage medium such as CD, etc. The coded data reproduced from such CD, etc. 
is first inputted to an inverse variable coding circuit 151 through an input terminal 50, at which header information, etc. 
is decoded every sequence, every frame group, and every frame. In the odd cycle of the frame, header information is 
decoded every slice (group of macro blocks), and the quantization width is included in the header information of this 
slice. Then, address data of the macro blocks, field orthogonal transform mode/frame orthogonal transform mode infor- 
20 mation, and macro block type data indicating a decoding system are decoded every macro block, and the quantization 
width is decoded in updating. 

[021 2] It is to be noted that generation of block data in the macro block is carried out in the frame orthogonal transform 
mode, the entirety of the macro block data is decoded in the odd cycle, whereas no data is decoded in the even cycle. 
In addition, in the case where generation of block data is carried out in the field orthogonal transform mode, only block 
25 data including odd fields of the macro block data is decoded in the odd cycle, and block data including even fields is 
decoded in the even cycle. 

[021 3] The picture information is decoded through an inverse quantizer 153 for carrying out an inverse quantization 
processing and an inverse DCT circuit 154 for carrying out an inverse DCT processing. The picture data thus decoded 
undergoes a processing for judging, in dependency upon the macro block type data, whether or not it is difference pic- 

30 ture information. In dependency upon the judgment result, a mode switch 157 for carrying out switching between addi- 
tion' to a reference picture and no addition to the reference picture (corresponding to non-intra/intra of the MPEG 
coding) by an adder 156 is switched. In the case of the I frame and the P frame, the decoded picture data are respec- 
tively inputted (interchangeably every time the I frame and the P frame are processed) to frame buffers 164 and 161. 
On the other hand, in the case of the B frame, the decoded picture data are inputted to a frame buffer 162. In this 

35 embodiment, each frame buffer is comprised of two field buffers, and odd/even field picture data are separately stored 
into the respective field buffers. Additionally, writing into the frame buffer is controlled by switching of a switch 158. 
[021 4] At this time, an address to be written into the frame buffer is given by any one of address generator 81 , 82 and 
83. Each address generator calculates an address increment value at the frame buffer from macro block address incre- 
ment data of the header information of the macro block to determine leading addresses of respective macro blocks 

40 data. 

[0215] Further, data of each quantization width is stored into the memory 152 by one field, respectively. This quanti- 
zation width data is sent to the inverse quantizer 1 53 through a switch 1 55 switched in dependency upon an output of 
the inverse variable coding circuit 1 51 . In the even cycle, since only macro block data processed in the field orthogonal 
transform mode is decoded, macro block address data and macro block type data to be decoded every macro block and 
as motion vectors required for a predictive system indicated by the macro block type data are decoded every field. Then, 
a difference picture further transmitted is added to a picture which has been motion-compensated from a reference 
field. Thus, a reproduced picture is obtained. 

[021 6] Data of the respective frame buffers 1 64, 1 62 and 1 61 are motion-compensated by the motion compensation 
processing circuits 165, 166, 159, 160 and 163. At this time, these respective motion compensation circuits carry out 
so switching between motion compensation of frame and motion compensation of field by the block generation mode 
(frame/field) in the DCT processing. 

[0217] The motion-compensated pictures are sent to respective selected terminals of selector switches 67, 68 and 

71 . These selector switches 67, 68 and 71 are switched so that a reference field or frame indicated by a decoding sys- 
tem of the macro block type is taken out. To the selector switch 71 , a signal obtained by adding outputs of the selector 

55 switches 67 and 68 at an adder 69 to divide it by two at a divider 170 and an output of the switch 67 are delivered. An 
output of this switch 71 is sent to the switch 157. 

[0218] Further, outputs of respective frame buffers 1 64, 161 and 162 are sent to a display 73 through a selector switch 

72. To the display 73, an output of the selector switch 72 switched so that picture data are displayed in order of repro- 
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duced pictures in place of the order of decoded pictures is delivered. Thus, a pictorial image is obtained. 
[021 9] From facts as described above, in the case where there is a moving body CA on this side of a still background 
as described in FIG. 23 previously referred to, for example, there is any motion between fields when attention is drawn 
to one frame. For this reason, such a portion takes a comb form. On the contrary, in accordance with the apparatus of 
this embodiment, since such a moving portion is coded in the field orthogonal transform mode, it can be processed as 
a picture having no movemeni, which is divided every fields. By ihe motion compensation between odd/even fields, a 
moving picture of a high picture quality can be reproduced with high efficiency. Namely, as shown in FIG. 20, for exam- 
ple, when the processing cycle is the odd cycle, a moving portion is processes in the field orthogonal transform mode, 
and a still or stationary portion is processed in the frame orthogonal transform mode. It is to be noted that the portion 
where a picture has been already formed in the even cycle becomes the portion indicated by slanting lines in FIG. 21. 
Portions except for the portion indicated by slanting lines in FIG. 21, i.e., moving portions are decoded by the motion 
compensation. 

[0220] Meanwhile, in this embodiment, since only macro block data processed in the field orthogonal transform mode 
is decoded in the even cycle, it is necessary to recognize a macro block address. There are two methods of recognizing 
a macro block address. One is a method of transmitting macro block address data every macro block in the even cycle 
as previously described. The other is a method of storing, by one field, information of field orthogonal transform 
mode/frame orthogonal transform mode in the odd cycle to obtain, by conversion, macro block address data which is in 
the field orthogonal transform mode from a train of respective processing mode information. The merit of the former is 
that supplement of any memory is unnecessary. On the other hand, the merit of the latter is that there is no increase in 
information transmitted. Recognition of the quantization width may be realized by transmitting such quantization width 
data every macro block without taking the method of storing them by one field in the odd cycle which has been already 
described. 

[0221] From facts as described above, in accordance with the decoding apparatus of this embodiment, an approach 
is employed to divide the processing of one frame into an odd cycle and an even cycle to carry out, in the odd cycle, 
switching between the frame orthogonal transform mode and the field orthogonal transform mode every macro block! 
or to carry out, in the odd cycle, every macro block, switching between the frame orthogonal transform mode and the 
field orthogonal transform mode and also carry out between the frame motion prediction mode and the field motion pre- 
diction mode, in dependency upon the first or second processing mode; to both decode the odd field and the even field 
in the frame processing, and to decode only the odd field in the field processing to store a quantization width in the odd 
cycle to motion-compensate only macro block data in the field orthogonal transform mode by using the stored informa- 
tion in the subsequent even cycle. Accordingly, on the coding apparatus coded data can be efficiently transmitted. 
Namely, it is possible to reproduce a moving picture of a high picture quaJity by a lesser quantity of information trans- 
mitted. 

Claims 

1 . An encoder for encoding a sequence of frame pictures, each frame picture being comprised of plural macroblocks 
(MB), each of said frame pictures having a first field picture (Odd) and a second field picture (Even); said encoder 
comprising: 

a motion detector for detecting motion within said frame pictures and said first and second field picture; 
a selector for selecting (34), in dependence upon said detected motion, either a first encoding mode or a sec- 
ond encoding mode on a frame picture basis; characterised by 

when said first encoding mode is selected, an orthogonal transform encoder carries out orthogonal transform 
encoding of said plural macroblocks by adaptively selecting on a macroblock basis either 

(i) a frame processing mode for orthogonally transforming a block comprised of a portion of a first field and 
a portion of a second field, or 

(ii) a field processing mode for orthogonally transforming a block comprised of either said portion of said 
first field or said portion of said second field; and 

when said second encoding mode is selected, said orthogonal transform encoder carries out orthogonal trans- 
form encoding of blocks composed only of said first field of a frame picture and then carries out orthogonal 
transform encoding of blocks composed only of said second field of said frame picture with said second field 
being predictively coded using said first field. 
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coding processing mode judgment circuit 34 calculates a sum of differences between absolute values of respective pix- 
els, e.g. , between an odd field (first field) and an even field (second field) of each frame to output coding mode data EN 1 
indicating that coding in the first coding processing mode has a higher efficiency when the value of the sum of differ- 
ences is less than, e.g., a certain threshold value TO (i.e., movement of picture is small), and to output coding mode 
5 data EN2 indicating that coding in the second coding processing mode has a higher efficiency when the value of the 
sum of differences is more than TO (movement of picture is great). 

[01 73] It is to be noted that, in judgment in the coding processing mode judgment circuit 34, motion vector data FDMV 
from the field motion detector 21 may be used to carry out judgment. Namely, such an approach may be employed to 
select the first coding processing when mode motion vector data FDMV between the odd field and the even field is less 
io thari'a certain threshold value to, and to select the second coding processing mode when that motion vector data is 
more than 10. 

[0174] When the coding mode data EN1/EN2 from the coding processing mode judgment circuit 34 is sent to the 
frame/field mode judgment circuit 33, frame orthogonal transform mode data MDFM or field orthogonal transform mode 
data MDFD corresponding to the coding mode data EN1/EN2 is outputted from the frame/field mode judgment circuit 
75 33. 

[0175] Namely, in the case where coding mode data from the coding processing mode judgment circuit 34 is data 
EN1 indicating the first coding processing mode, the frame/field mode judgment circuit 33 conducts a processing to 
adaptively carry out switching between the frame orthogonal transform mode and the field orthogonal transform mode 
every respective macro blocks in one frame. Accordingly, the frame orthogonal transform mode data MDFM or the field 

20 orthogonal transform mode data MDFD adaptively switched is outputted from the frame/field mode judgment circuit 33. 
[0176] On the contrary, in the case where coding mode data from the coding processing mode judgment circuit 34 is 
data EN2 indicating the second coding processing mode, the frame/field mode judgment circuit 33 carries out, in the 
field orthogonal transform mode, generation of block data for orthogonal transfer processing of all macro blocks in one 
frame as described above. Accordingly, the field orthogonal transfer mode data MDFD is outputted from the frame/field 

25 mode judgment circuit 33. 

[0177] Any one of frame/field orthogonal transform mode data MDFM/MDFD outputted from the frame/field mode 
judgment circuit 33 and the coding mode data EN1/EN2 from the coding processing mode judgment circuit 34 are trans- 
mitted to the address generator 35 and the group of frame memories 20 with motion compensator. In addition, the 
orthogonal transform mode data (MDFM/MDFD), the motion predictive mode data (MPFM/MPFD), the coding mode 

30 data EN1/EN2, and the motion vector data (FMMV/FDMV) are sent also to the above-described variable length coding 
circuit 15. 

[0178] The address generator 35 controls the group of frame memories 10. Namely, as described above, in the case 
of the first coding processing, the address generator 35 controls the group of frame memories 10 so as to output macro 
block data generated in correspondence with the mode (data MDFM/MDFD) for generating block data for orthogonal 
35 transform processing in the odd cycle. Further, in the case of the second coding processing mode, the address gener- 
ator 35 controls the group of frame memories 10 so as to output macro block data generated in correspondence with 
the field orthogonal transform mode (data MDFD) in the odd cycle and the even cycle. 

[0179] In other words, for example, in the case where the first coding processing mode is selected and the coding 
mode data EN1 is delivered to the address generator 35, if the orthogonal transform mode data is, e.g., data MDFM 

40 indicating DCT processing every frame, this address generator 35 controls the group of frame memories 10 so as to 
output macro block data in which even and odd lines are scanned one after another as shown in FIG. 5(B) (macro block 
data every frame in which odd and even fields are combined). Namely, in this case, the address generator 35 controls 
the group of frame memories 10 so that data of four blocks of 8 lines x 8 pixels (macro blocks) obtained by dividing a 
macro block of 1-16 lines into a macro block of 1-8 lines and a macro block of 9-16 lines is outputted at a time. 

45 [0180] In the case where the first coding processing mode is selected and the coding mode data EN1 is delivered to 
the address generator 35, if the orthogonal transform mode data is, e.g., data MDFD indicating DCT processing every 
field, the address generator 35 control the group of frame memories 1 0 so as to output macro block data in which even 
and odd lines are separately scanned as shown in FIG. 5(C) (macro block data every field comprised of the odd and 
even fields). Namely, the address generator 35 controls the group of frame memories 10 so that two blocks of 8 lines x 

so 8 pixels (macro blocks) are respectively outputted at a time in the odd and even fields obtained by dividing lines into first 
line, third line, fifth line, seventh line, ninth line, eleventh line, thirteenth line, and fifteenth line (respective lines of the 
odd field or the first field); and second line, fourth line, sixth line, eighth line, tenth line, twelfth line, fourteenth line, and 
sixteenth line (respective lines of the even field or the second field). 

[0181] In addition, for example, in the case where the second coding processing mode is selected and coding mode 
55 data EN2 is delivered to the address generator 35. the address generator 35 control the group of frame memories 10 
so as to output macro block data generated in correspondence with the field orthogonal transform mode in the odd 
cycle and the even cycle as described above. Namely, for a time period during which the second coding processing 
mode is selected, the address generator 35 controls the group of frame memories 10 so that two block data of 8x8 (only 
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